Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: yongtao Date: Sep 4, 2012 2:26am
Forum: web Subject: robots.txt

I put robots.txt on my sites(you may access it as http://www.lehmanco.com/robots.txt), but the archived pages still can be access on the backway machine, what can I do?

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffJeff Kaplan Date: Sep 5, 2012 12:32am
Forum: web Subject: Re: robots.txt

Take down requests can be sent to info@archive.org.

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffHydriz Date: Sep 4, 2012 11:23pm
Forum: web Subject: Re: robots.txt

The change isn't instant, might take a few weeks, months or at most a year before the archived pages are removed off the Wayback machine.